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PACS 05 . 40 . -a - Fluctuation phenomena, random processes, noise, and Brownian motion 
PACS 05.45.Xt - Synchronization; coupled oscillators 
PACS 87. 19.1 j - Noise in the nervous system 

Abstract -We investigate how correlations between the diversity of the connectivity of networks 
and the dynamics at their nodes affect the macroscopic behavior. In particular, we study the syn- 
chronization transition of coupled stochastic phase oscillators that represent the node dynamics. 
Crucially in our work, the variability in the number of connections of the nodes is correlated with 
the width of the frequency distribution of the oscillators. By numerical simulations on Erdos- 
Renyi networks, where the frequencies of the oscillators are Gaussian distributed, we make the 
counterintuitive observation that an increase in the strength of the correlation is accompanied 
by an increase in the critical coupling strength for the onset of synchronization. We further ob- 
serve that the critical coupling can solely depend on the average number of connections or even 
completely lose its dependence on the network connectivity. Only beyond this state, a weighted 
mean-field approximation breaks down. If noise is present, the correlations have to be stronger to 
yield similar observations. 
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Introduction. — In the last decade network science 
has become a field of research with increasing importance. 
This is mainly due to the fact that in principle any kind of 
coupling structure can be mapped to a network of specific 
complexity. In this way, one aims for understanding funda- 
mental properties that networks with given structure may 
have in common. Besides a large variety of locally con- 
nected networks, the two most prominent examples were 
coined by Watts and Strogatz Q] , and Barabasi and Albert 
[2] , who showed that various networks can be divided into 
so-called small-world or scale-free networks, respectively. 
In small-world networks, all the nodes typically have the 
same range of neighbor connections plus a few random 
shortcuts are established. In contrast, scale-free networks 
are characterized by a significant amount of "hub" nodes 
with a very large number of connections. Network sci- 
ence further owes its popularity to the growing relevance 
of interdisciplinary topics and to the advances in computer 
technology and science [3|. 

One important topic is the study of the interplay be- 
tween network topology and dynamics on the nodes, as 
impressively reviewed in [JHH] • We pose the question, how 



correlations between connectivity and dynamics on the 
microscopic level affect the macroscopic behavior of a net- 
work. Such a connection between the numbers of links in a 
network and the functional ability of the node dynamics is 
evident and possibly caused by various reasons, for exam- 
ple by limited energy supply, restricted space or chemical 
resources, etc. Indeed, interneurons and pyramidal cells 
differ in the typical number of synaptic connections and 
firing rates . 

In order to approach the problem, we investigate the 
synchronization transition of phase oscillators in complex 
networks. The phenomenon of synchronization suits a 
benchmark by virtue of its importance as a paradigmatic 
emergence of collective behavior, as outlined for instance 
in EUTDI. 



Only recently, Gomez- Gardehes et aZ.showed that a spe- 
cial type of such a correlation can lead to an onset of syn- 
chronization resembling a first-order phase synchroniza- 
tion . This is remarkable, because the synchronization 
transition was always found to be of second order, if one 
only considers how different network topologies affect the 
dynamics. They instead identified the natural frequency of 
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each node with its individual degree oj = k, i.e., its number 
of connections. Furthermore, they interpolated between 
Erdos-Renyi random networks and scale-free networks. In 
this way it was found that the first-order nature of the 
synchronization transition appears only in scale-free net- 
works; those networks are characterized by an unlimited 
dispersion of degrees. Hence, it was shown that a positive 
correlation between the dynamics of the oscillators and 
the large heterogeneity of the network has a drastic effect 
on the onset of synchronization. 

In this Letter, we consider a more general correlation 
between the degree and the frequency distributions; we 
relate the diversity of the frequencies to the degrees. Two 
different settings are generated, namely either positive or 
negative correlations between the degree of a node and 
how broad its oscillatory frequency varies from the mean 
one. We explore whether this kind of correlation with fixed 
average natural frequency is enough to yield a notable im- 
pact on the synchronization transition. In particular, we 
focus on the Erdos-Renyi random network model, which 
often serves as an important benchmark [12] . We show by 
simulations that the correlations can either support or im- 
pede the synchronizability. The results are supported by 
help of a weighted mean field theory [13] which allows to 
formulate quantitative dependencies for the critical cou- 
pling within the validity of the approximative theory. We 
conclude by a qualitative discussion of our findings. 

How degree-frequency correlations affect the 
synchronization transition. The most prominent 
model in studying synchronization phenomena is the Ku- 
ramoto model fH] 

N 

4>i (*) = wi + jjj J2 A v sin (*) - & (')) + & (*)> w 

3=1 

where i = 1, . . . , N, with natural frequency u>i and phase 
4>i(t) of oscillator i at time t, respectively. The coupling 
strength is denoted by re, the number of oscillators by N 
and q is a denseness parameter scaling the number of links 
with changing N; for q = the network is sparse, while it 
is dense for q = 1. Such a normalization is appropriate as 
long as all the degrees share the same scaling with the sys- 
tem size. Otherwise one may choose the maximum degree 
occurring in the network to guarantee an intensive cou- 
pling term [8]. We consider undirected and unweighted 
networks, in which case the adjacency matrix is symmet- 
ric with elements Aij = 1, if the units i and j are cou- 
pled, otherwise = 0. Complex topologies of real-world 
networks can be encoded into the adjacency matrix, and 
decoded by counting all the degrees, which are given by 

N 

ki = 2^ Aij, (2) 

3=1 

ki > by definition. Calculating the probabilities of oc- 
curring degrees, yields the degree distribution P(k). Vari- 
ous stochastic processes are brought together in the noise 




Fig. 1: (Color online) Conditional Gaussian frequency distribu- 
tion with (To = 1 shown as a function of the correlation power 
n and the relative degree k/{k) (inset). 

terms &(t), such as the variability in the release of neu- 
rotransmitters or the quasi-random synaptic inputs from 
other neurons |15) . The sum of stochastic influences is 
modeled by Gaussian white noise: 

(&(«)> =0, 

The single parameter D scales the noise intensity and is 
nonnegative. The angular brackets denote an average over 
different realizations of the noise. 

There are various possibilities how the individual oscil- 
lation frequencies and degrees can be correlated, including 
correlations between the mean values or the widths of the 
corresponding distributions. In |16] the frequencies and 
degrees are assumed to be proportional, hence mean val- 
ues and widths of the frequency and degree distributions 
are directly correlated. It is found that with increasing 
positive correlation, the oscillators are easier to synchro- 
nize. This phenomenon gives rise to the fact that one can 
observe an abrupt synchronization transition, if the natu- 
ral frequencies and degrees are identified |llj . 

However, we remark that with respect to many real- 
world systems, one cannot observe a direct correlation be- 
tween individual dynamics and connectivity. In neuronal 
networks for instance, a higher number of connections is 
not directly linked to a higher neuronal firing rate with 
respect to one cell type. This is due to the balance of 
inhibition and excitation |17| . where de- and acceleration 
compensate each other. Therefore, the central idea of our 
Letter is to consider correlations that are due to or affect 
only the variability in the degree or the frequency dis- 
tribution, respectively. Hence, the mean values are not 
affected. To this end, we assume 

y^) =*■„(**). (4) 

Each oscillator draws its natural frequency from the same 
distribution function, but with an individual standard de- 
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Fig. 2: (Color online) The critical coupling strength depicted as a function of the inverse edge probability, which is proportional 
to the inverse average degree, see Eq. (|7|). Measurements are done via finite-size scaling analysis with systems of size N = 
300, 500, 800, f 200 and q = 0.4. Furthermore, a Gaussian frequency distribution is used with zero mean and standard deviation 
o~ n (ki), where ao = 0.2 (cf. Eq. ([5])). Markers connected by dashed lines (red) show simulation results, while (blue) solid lines 
depict corresponding theoretical results, obtained by numerical integration. The thick solid (green) line in panel (d) is exactly 
obtained by Eq. (|15[) with n — 1,2. The arrows show the direction of increasing n, from n = —2 to n = 4. Panels (a)-(d) 
show results with decreasing noise intensity: (a) D = 1.5, (b) D = 0.5, (c) D = 0.05, and (d) D = 0. Inset in (c) presents k c 
comparing ao — 0.2 with ao — 0.02 in case of n = 3. Inset in (d) depicts the discrepancy K c ,sim — ^c,Th between simulation and 
theory as a function of the denseness parameter q in case of n — 1 and p = 0.1. In the unshaded regions of (a)-(d) simulation 
results are accompanied by theoretical results, whereas in the shaded areas (orange) in (c) and (d) a superlinear growth of k c 
cannot be described by our mean-field theory. 



viation, given by the degree ki. Here, a n {ki) is an abbre- 
viation for the power-law function 

a n (ki) = a (jj^J ,n£l. (5) 

We call n the correlation power; uq stands for the original 
standard deviation without correlations. Eq. §5§ gives rise 
to two different settings, namely cither positive, n > 0, 
or negative correlations, n < 0. Note that for k < (k), 
i.e. nodes with degrees smaller than the average degree, 
the natural frequencies are the more sharply distributed 
around the mean frequency, the larger is n, while for k > 
(fc) it is just the opposite case (see Fig. Q]for visualization). 

We consider Erdos-Renyi like random networks that are 
constructed by assigning an edge probability 

Pe = P -Ni-\ 0<p,q<l (6) 

for any two of the N nodes in the network with the scaling 
parameter q introduced in Eq. ([T]). The further additional 



requirement is that besides the edge probability, each node 
is a priori connected to another randomly chosen one. In 
this way we guarantee that there are no isolated nodes, 
which are not interesting here, because they are not able 
to take part in the synchronization process and they only 
reduce the effective system size. Hence, the average degree 
reads 

(h)=2+pN*(l-iy (7) 

which is approximately pN q for q > and N — s- oo. The 
first term in Eq. (J7|) stems from the random connections 
that arc a priori chosen, whereas the second term is a 
result of the edge probabilities, Eq. ©. Higher moments 
and the degree distribution P(k) are not known exactly. 
However, for large systems and q > 0, the second term 
in Eq. (0 dominates and the degrees become binomially 
distributed [5]. 

In our simulations, the stochastic differential equations 
are integrated up to t = 600 with time step At = 0.05 
by using the Hcun scheme. We consider a Gaussian frc- 
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quency distribution with zero mean and standard devia- 
tion a n (ki), where ao = 0.2 (cf. Eq. (J5J). Moreover, we 
discard the data up to t — 200, by which transient effects 
are safely avoided. The statistical equilibria are further 
calculated as averages over at least 100 different network 
realizations. The different network configurations do not 
differ only in the configuration of the connections, but the 
oscillators on the network differ as well: all the natural fre- 
quencies and the initial values of the phases change from 
one configuration to another. 

In order to measure the critical coupling strength, we 
perform a finite-size scaling analysis [T3TT8] , where we take 
networks of size TV = 300, 500, 800, 1200 with q = 0.4. Fig. 
[2] displays the measured critical coupling strengths (red 
circles). As expected, both a larger noise intensity D and 
a decrease of the number of connections, here parameter- 
ized by the inverse edge probability 1/p, impedes the syn- 
chronizability. This causes the higher coupling strength k c 
needed for the onset of synchronization (compare panels 
(a)-(d)). 

Besides that, we observe that n c increases with the cor- 
relation power n, which is by far not a foregone conclusion. 
One could have expected that both settings of correlation, 
i.e. n < and n > in (|5|), lead to a decrease of K c , be- 
cause the latter marks the transition from the completely 
asynchronous to a partially synchronous state, and not 
to the completely synchronous state. For any correlation 
power, oscillators with a narrower frequency distribution 
appear which are easier to synchronize. Hence, a lower 
coupling strength would be needed for the onset of syn- 
chronization. 

Instead, the uncorrelated case n = needs a critical 
coupling strength intermediate to the two settings with 
n / 0. Positive correlations require higher critical cou- 
pling strengths k c , negatively correlated networks can be 
easier synchronized, i.e. k c decays. 

First, we provide an intuitive explanation for this obser- 
vation above; in the next section a mathematical reasoning 
will be given. The phenomenon of synchronization arises 
by virtue of interactions. Therefore, nodes with a larger 
degree k > (k) (hubs) are more crucial than nodes with 
a smaller degree k < (k). If the frequencies of these hubs 
are much broader spread around the average frequency, it 
is more difficult for the whole network to exhibit a syn- 
chronized oscillation. In other words, a population of os- 
cillators is easier to synchronize, if the important nodes 
possess frequencies closer to the average frequency. In 
particular, for the case n > 0, hubs are favored to have 
a great variability of frequencies, whereas sparsely linked 
nodes do the opposite. Necessary coupling for the onset 
of synchronization has to be larger than in the uncorre- 
lated case. Differently for n < 0, the less linked nodes 
own an increased variabilty compared to the uncorrelated 
case, but the hubs are now easier to synchronize since their 
frequencies are narrower distributed. 

We further observe that the curves for different n ap- 
proach each other with increasing noise intensity D. This 



is due to the fact that a strong noise outweighs the diver- 
sity of the oscillators given by the frequency distribution; 
the effect of correlations is destroyed for large noise inten- 
sities and they become negligible. 

Finally, it turns out to be beneficial to plot the criti- 
cal coupling strength n c as a function of the inverse edge 
probability 1 jp as done in Fig. [2] In this way we observe 
two distinct regions: for small correlation power n, the 
critical coupling strength increases sublinearly as a func- 
tion of 1/p, while for large n, it increases superlinearly. 
In panel (d) a linear dependence is located between n = 1 
and n = 2 for D = 0. For larger noise intensities or smaller 
standard deviations <j$ (compare inset in panel (c)), the 
separation between the two regions appears for larger cor- 
relation powers n. The shaded areas (orange) in panels 
(c) and (d) depict up to which n we find the supcrlinear 
region by numerical simulations. 

A linear dependence indicates that the onset of synchro- 
nization k c solely depends on the mean degree (k), which 
is determined by p. Hence, for a certain n c , the onset of 
synchronization becomes independent of higher moments 
of the degree distribution. The heterogeneity in the net- 
work is masked by the correlations. 

Theoretical considerations. — In what follows, we 
discuss an approximation scheme |13| that allows to re- 
produce analytically our observations above. We replace 
the random network by a fully connected network with 
random coupling weights that mimic the actual network 
structure. Requiring thereby the conservation of the indi- 
vidual degrees, ki = Ylj=i Aij, i= 1, . . . , JV (cf. Eq. $2$), 
the elements of the approximated adjacency matrix read 



(8) 



Inserting this into Eq. ([T]) yields a weighted mean-field 
approximation and effectively a one-oscillator description 
[13j . In the following we consider the thermodynamic limit 
N — > oo, where the system is conveniently described by 
the density p(<fi,t\u),k), which is normalized according to 
J Q 27r p{<j>, t\uj, k)dcj) = 1 V u, k,t. 

For given degree k and natural frequency u>, 
p(4>,t\ui,k)d(j> gives the fraction of oscillators having a 
phase between cf> and cf> + dcf> at time t (indices can be 
neglected, since all the nodes are assumed to be statisti- 
cally identical). 

The completely asynchronous state is given by 
p(4>, t\u),k) = 1/ (27r) Vu,/;,t and we aim at calculating the 
critical coupling strength, where it loses its stability, which 
marks the onset of synchronization. The linear stability 
of the completely asynchronous state is characterized by 
a single real-valued eigenvalue A given by a self-consistent 
equation |13j : 



2N*{k) 



+ 00 



(A + £>)fc' 2 
■f (\ + D) 2 + uji 



r P(o/,fc') . (9) 
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The sum over k' covers all possible degrees, which could 
be further approximated by an integral. The joint proba- 
bility density P(ui,k) takes into account the possibility of 
correlations between the frequencies and degrees. In the 
derivation of Eq. © we assume that, with regard to the 
w-dependency, P(u>, k) has a single maximum at frequency 
<jj = (this choice is always possible due to the rotational 
symmetry) and is symmetric with respect to it. 

The critical condition A = A c — yields the critical 
coupling strength 



k c = 2N q (k) 



r +oc ~ Dk n 



(10) 

This equation is not valid in the noise-free case, where 
one has to take the limit A — > + in Eq. ([9]) with D = 
resulting in 



k c = 2N q (k) 



(11) 



To sec this, note that lim^^ + /_ °° dw'A/ (A 2 + u/ 2 ) = 

Assuming a given degree distribution P(fc), the joint 
frequency and degree distribution separates as P(oj,k) = 
g(u>\k)P(k) with the conditional frequency distribution 
g(uj\k). It gives the probability that an oscillator at a 
node with degree k has the natural frequency uj. It in- 
cludes the relation (j4]), i.e. the correlations between the 
degree and the frequency variation. 

First, in accordance with the numerics above, we con- 
sider a Gaussian frequency distribution: 



SgaussHfc) = 



27T(7„(fc) 



(12) 



and a n (k) is expressed by Q. Taking the integral, we 
derive the critical coupling strength (fTUl) : 



= 2\/-a Q N q (k) 



x ( k 2 ~ n erfc 



D 



exp 



D 2 



2<r„(fc)< 



(13) 

which is an intensive parameter and scales with the vari- 
ation of frequencies for small cto (see inset in panel (c) of 
Fig. |2). 

By calculating d« c /dn, we want to validate that the 
critical coupling strength indeed grows with the correla- 
tion power, as stated in the previous section. To this end, 
we use Eq. (| 13[) and arrive at a sufficient condition for 
dft c ,gau SS /d?i > 0, namely 



—j=y > ( 2 y 2 - i) ex P (y 2 ) erfc (y) 



(14) 



with y = D ((k)/k) n / (V2CT0). Since we always have y > 
0, the inequality (|T4"]) is true; in fact, the right-hand side 
divided by y, approaches 2/y / 7r from below for y going to 
infinity. 

In the noise-free case D = we find 



Kcgau»(I> = 0) =2d~<r N q 



7T " (fc 2 -«) 



(15) 



Interestingly, for n = 1 and n = 2, we get the same 
critical coupling strength growing inversely to the average 
degree: 

ft Cj gaussOD = 0,n = l,2) = 2W-^ (16) 

V 7T p 

in the thermodynamic limit (cf. Eq. (J7J). In Fig. [5] the 
solid blue lines describe the critical coupling strength as 
given by numerical integration of Eqs. (fT3|) or (|T5|) with 
a binomial degree distribution and system size N = 1000. 
In panel (d) for n = 1,2, instead of the numerical integra- 
tion of Eq. (fT5"j) . the exact expression (fT6|) is shown (thick 
green line) . The agreement between theory and simulation 
is satisfactory in (a)-(d) and confirms the previous obser- 
vations. The weighted mean-field approximation does not 
yield superlinear dependencies. Simulation results in the 
shaded (orange) areas in panels (c) and (d) are therefore 
not covered by the theory; the validity of the approxima- 
tion restricts to correlation strengths with sub- and linear 
growth of k c . For large noise intensities D the theory over- 
estimates the critical coupling strength k c , irrespective of 
the correlation power n, but this may turn into the oppo- 
site case when decreasing D depending on n. In summary, 
there seems to be some particular noise values where the 
agreement between theory and simulation is particularly 
good. As presented in the inset of panel (d), deviations 
between the results from the numerical simulations K c ,Sim 
and from the weighted mean-field theory k Cj tii can be fur- 
ther reduced by increasing q. Hence, more densely con- 
nected networks are better reflected by the theory. 

Generalizations. — The network model under con- 
sideration constitutes already a generalized model, since 
it allows to interpolate between sparse and dense random 
networks. Here we discuss two further generalizations, 
namely other frequency distributions and different nor- 
malization variants of the coupling term, cf. Eq. (JXJ) . In 
particular, wc consider now a Lorentzian and a uniform 
frequency distribution: 



5lorentz(w|fc) 

g uni (uj\k) = 



a n {k) 



1 



7T <J n (k) 2 + UJ 2 ' 
1 



2y/3a n (k) ' 



< Vz<j n (k), 



(17) 



Note that in case of the Lorentzian, a n (k) does not have 
the meaning of a standard deviation, instead it is the scale 
parameter for the width of the distribution. Wc further 
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introduce a generalized normalization Af(k) instead of N q , 
which can be a function of the degree k. Then we find for 
the critical coupling strength: 



^c.lorcntz — ^(^) 



Af(k) D + a n (k) 



I k 2 ~ n 



arctan 



V3a n (k) 



D 



(18) 

Let us now specify the normalization Af(fc) by consider- 
ing two cases: J\f(k) — (k) and Af(k) = k. In the first 
case, one assumes again that the system-size scaling of 
the number of connections is the same for all nodes. In 
order to distinguish the two normalizations, we denote the 
critical coupling strength by n a or k. w , respectively. In the 
noise- free case D = we obtain, in contrast to (fl~5j). the 
following relations with the same constant of proportion- 
ality C: 



K a = Ca 



= Ca 



(k 1 



(19) 



(fc 2 -») ' 

irrespective of whether we consider a Gaussian, a 
Lorentzian or a uniform frequency distribution. Only the 
constant of proportionality C is different, namely C gaU ss = 
2^/2/^ « 1.60, Ci orcntz = 2 or C uni = 4V3/tt « 2.21. 

Again we find a disappearance of network effects for 
specific correlation powers. The phenomenon is even more 
pronounced here, since n a becomes a constant for n — 1,2. 
Moreover we see that K w {n) = K a {n + 1). Correspond- 
ingly, k w becomes a constant for n = 0,1. It has been 
pointed out in the literature, e.g. in [8], that the addi- 
tional weight introduced by the normalization Af(k) = k 
can mask the heterogeneity of the network. Our results 
constitute a generalization of this statement. Preliminary 
numerical simulations can reproduce our theoretical re- 
sult K w (n) = K a (n + 1), while the point where the onset of 
synchronization loses its dependence on the network con- 
nectivity is found to appear at smaller values of n than 
predicted by the theory. 

Conclusion. — We assumed correlations between the 
degree number in a complex betwork and the variance of 
frequencies of phase oscillators belonging to the nodes. By 
estimating numerically and analytically the critical cou- 
pling strength that marks the onset of synchronization, 
we were able to show that correlations can favor as well 
as impede the ability of creating coherent network oscil- 
lations. In both scenarios, the behavior of hubs (nodes 
with large degree) plays a dominant role. Stronger cou- 
pling is necessary, if the hubs have broadly distributed 
frequencies. The onset of synchonization is shifted up, 
despite the fact that the less linked nodes possess a nar- 
rower frequency band and would, taken separately, syn- 
chronize at lower couplings. The opposite happens in case 
that hubs have narrowed distributions. We have further 
demonstrated that noise acting on the frequencies plays a 



crucial role; correlation effects become maximally strong 
in case of vanishing noise intensity. 

We mention that our analysis was performed for edge 
probabilities p larger than 0.1. In this region we have 
found a good applicability of the weighted mean field the- 
ory proposed in [13]. Analytical results agreee satisfacto- 
rily with numeric ones for sufficiently large noise D or not 
too strong correlation powers n and dense enough scaling 
of the links q > in particular, as long as the critical 
coupling grows sub- or linearly with I /p. Beyond a cer- 
tain denseness parameter for given correlation power, the 
weighted mean-field approximation breaks down. 
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